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Abstract 

We estimate the condition number of a matrix by applying the Power Method, that is essen- 
tially a sequence of matrix-by-vector multiplications, similarly to the Lanczos-based estimators. 
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Condition estimation is fundamental task for for numerical matrix computations, supported by a 
number of effective algorithms jGLMl Sections 2.3.2, 2.3.3, 3.5.4, 12.5], [Hfel Chapter 15], and [SMl 
Section 5.3], which rely on solving linear systems of equations or orthogonalization. These techniques, 
however, are not friendly to sparse and structured inputs of large sizes, and this motivates creating 
alternative methods, employing matrix-by- vector multiplications instead. We describe such a simple 
estimator based on the Power Method, which is similar to the Lanczos-based estimators. 

Assume a real symmetric nonnegative definite n x n matrix S and apply the Power Iteration 

V,. = 5'v = 5vfe_i, fc = l,2,... (1) 

for a random vector v = vq to approximate the largest eigenvalue A — X{S) of the matrix S by 
the Rayleigh quotients Qi = v^5'vfc/v^Vfc. Using the Power Method for the norm estimation was 
proposed in |B74j . The paper |D83) proved that qt < A 9qk with a probability at least 1— 0.86'^'''/^n^/^ 
for any scalar > 1. This estimate defines a stopping criterion for the iteration, and heuristically 
one can also stop where qi/qi-i w 1 or ||5'vi — (7zVi||/(|qi)| ||vi||) <t for a fixed tolerance t. Instead 
of the Rayleigh quotients one can use the simple quotients Si = ef Svk/ef-Vk for the ith coordinate 
vectors e^ and fixed or random integers i = i{k), 1 < i < n (cf. |BGP04j . |PQZC| ), |PZllj ). 

Now assume an to x n matrix A for m>n, let (Jj{A) denote its jth largest singlular value, and 
seek a crude estimates for cti{A) and cr„(A), e.g., to decide whether the matrix is well conditioned. 
One can approximate the smallest eigenvalue of the matrix A^A, equal to a'^{A), by applying the 
Power Method to the inverse matrix {A^A)~^ (cf. |H021 Chapter 15]), but this involves solving linear 
systems of equations, and we can avoid that as follows. 

Apply the power iteration ([T]) to the matrix S — A^A to compute a close upper bound cr^ on 
X{S) = = o'i(^)- Then apply the power iteration ([T]) to the matrix B ~ a\l — A^ A to 

compute an approximation A+ to its largest eigenvalue and then obtain a\ — \+ ~ a'^{A). An even 
superior alternative is to approximate both largest and smallest eigenvalues of A by applying the 
Lanczos algorithm, which converges faster than the Power Method |KW92| . 

For m < n apply the same techniques to the matrix AA"'" . 
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